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ABSTRACT 


This  thesis  presents  an  extension  of  the  numerical 
algorithm,  due  to  Julius  and  Charmonman,  for  determining 
graph  isomorphisms  for  graphs  with  distinct  eigenvalues 
to  include  graphs  with  one  or  more  multiple  eigenvalues. 
The  extended  algorithm  is  programmed  and  implemented 
on  an  IBM  S/36O/67  computer  and  an  estimate  of  its 
efficiency  is  made. 
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CHAPTER  I 


INTRODUCTION 

1 . 1  Literature  Review 

Since  the  appearance  of  the  first  paper  on  graph 
theory  by  Euler  in  1736  [18],  the  theory  of  graphs  has  been 
developed  extensively  (see  [3],  [43,  [13]  and  [19])  and 
is  used  in  a  wide  variety  of  applications  (see  [3],  [4], 

[6],  [11],  [13]  and  [18]).  However,  very  little  research 
was  devoted  to  solving  the  graph  isomorphism  problem  until 
the  late  1950* s.  The  research  in  this  area  has  been 
primarily  stimulated  by  the  chemical  industry  in  their 
attempts  to  develop  an  efficient  chemical  information 
retrieval  system  for  the  cataloguing  and  documenting  of 
organic  compounds  ([1],  [9]a  [10]  and  [28]).  In  a  retrieval 
system,  the  problem  of  matching  a  given  compound  or  query 
structure  to  those  on  file  or  in  storage  is  equivalent  to 
the  graph  isomorphism  problem. 

In  theory,  the  graph  isomorphism  problem  is,  in  a 
certain  sense,  trivial.  That  is,  since  there  are  only  n! 
ways  in  which  the  nodes  of  an  n-node  graph  may  be  labelled, 
the  graph  isomorphism  problem  consists  simply  of  generating 
the  n!  mappings  of  one  graph  into  the  other  and  testing 
to  see  if  the  conditions  for  isomorphism  are  satisfied  for 
any  of  these  mappings.  In  practice,  however,  since  n! 
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becomes  extremely  large  even  for  relatively  small  n  ,  this 
combinatorial  approach  is,  in  general,  inefficient.  For 
example,  Unger  [27]  has  estimated  that  it  would  require 
about  one  hour  to  compare  two  10-node  graphs  and  about 
forty  years  to  compare  two  15-node  graphs  using  this 
approach.  Moreover,  these  estimates  were  based  on  the 
modest  assumption  that  each  trial  would  require  one 
millisecond . 

The  first  attempts  to  solve  the  graph  isomorphism 
problem  were  the  node-by-node  matching  algorithms  [5],  [7] 
and  [21].  These  algorithms  consist  of  matching  two  graphs 
node-by-node  until  either  a  complete  match  is  found  or 
until  an  incompatibility  arises.  When  an  incompatibility 
results,  it  is  then  necessary  to  backtrack  to  a  point 
where  there  is  agreement  and  try  another  path.  This 
node-by-node  matching  technique  requires  an  excessive 
amount  of  backtracking  and  if  the  two  graphs  are  not 
isomorphic,  then  all  possible  paths  must  be  tried  before 
this  conclusion  is  drawn.  Moreover,  Sussenguth  [24]  has 
.shown  that  the  time  required  to  compare  two  n-node  graphs 
by  the  node-by-node  matching  algorithms  is  an  exponential 
function  of  n  .  Hence,  the  node-by-node  matching 
technique  is  not  efficient  as  a  general  algorithm  for 
solving  the  graph  isomorphism  problem. 

A  heuristic  algorithm  (GIT)  was  developed  by  Unger  [27] 
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for  determining  complete  isomorphisms  between  directed  line 
graphs .  This  algorithm  was  a  significant  improvement  over 
the  combinatorial  methods  and  is  described  in  detail  in 
[27].  GIT  was  written  in  COMIT  programming  language  and 
tested  successfully  on  an  IBM  7090  computer.  The  algorithm 
consists  of  setting  up  correspondences  between  sets  of 
nodes  of  the  two  graphs  that  exhibit  similar  properties. 

The  sets  are  generated  according  to  certain  nodal  functions 
and  the  sets  are  then  refined  by  various  procedures. 
Occasionally,  a  guess  is  made  with  respect  to  specific 

*/ 

nodes  to  see  if  an  isomorphism  results.  Ultimately,  the 
algorithm  either  detects  an  isomorphism  between  the  two 
graphs  or  a  contradiction  is  encountered,  in  which  case  no 
isomorphism  is  possible.  In  general,  this  algorithm  is 
considerably  more  efficient  than  the  previous  ones  and 
avoids  a  lot  of  unnecessary  backtracking  in  most  instances. 
However,  if  the  graphs  in  consideration  are  highly 
symmetric  and  the  nodal  functions  fail  to  distinguish  the 
nodes  to  any  great  extent,  then  the  algorithm  has  to 
distinguish  nodes  artificially  and  the  amount  of  back¬ 
tracking  required  by  the  algorithm  increases  considerably 
and  hence  the  efficiency  is  reduced.  Unger  states  that 
the  graphs  with  a  high  degree  of  symmetry  represent  the 
most  difficult  cases  for  GIT.  The  time  required  to  compare 
some  non-trivial  7-node  graphs  was  of  the  order  of  tens 


4 


of  seconds  and  some  24-node  graphs  required  about  two 
minutes.  A  pair  of  12-node  graphs  of  the  ’worst’  type 
required  approximately  7^  minutes  while  a  pair  of  16-node 
graphs  used  12  minutes  of  computing  time  without  producing 
a  solution.  It  was  estimated  that  12  additional  minutes 
would  have  been  required  to  produce  a  solution  for  the 
16-node  graphs. 

Meanwhile,  working  independently  at  Harvard  University, 
Sussenguth  [24]  developed  a  topological  structure-matching 
procedure  utilizing  an  approach  similar  to  Unger's.  The 
structure-matching  algorithm  of  Sussenguth’s  is  based  on 
simple  set  and  graph  theoretic  concepts.  The  algorithm 
sets  up  correspondences  between  sets  of  nodes  of  the  two 
graphs  which  exhibit  equivalent  properties  and  uses  a 
standard  partitioning  procedure,  based  on  set  theoretic 
principles,  to  reduce  the  sets  into  smaller  subsets.  Other 
procedures  are  used  to  generate  new  subsets  until  eventually, 
a  one-to-one  correspondence  is  delineated  or  a  contradiction 
occurs,  indicating  that  the  two  graphs  are  not  isomorphic. 

The  details  of  these  procedures  are  described  in  [22],  [23], 
[24]  and  [25].  The  algorithm  was  programmed  in  assembly 
language  and  run  successfully  on  an  IBM  7090  computer. 

The  algorithm  developed  by  Sussenguth  is  more  efficient 
than  Unger's  and  has  the  additional  feature  that  it  is 
capable  of  detecting  subgraph,  partial  graph  and  partial 
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subgraph  matches.  Moreover,  Sussenguth  has  shown  in  [24] 

that  the  computation  time  required  by  the  structure- 

2 

matching  procedure  is  proportional  to  n  .  Furthermore, 
Sussenguth’s  structure-matching  algorithm  requires  little 
or  no  backtracking  unless  the  degree  of  symmetry  of  the 
graphs  is  high.  However,  for  graphs  with  up  to  fifty 
nodes,  isomorphisms  were  detected  in  6  to  7  seconds  while 
only  a  few  milliseconds  were  required  to  determine  that 
no  isomorphism  existed. 

Several  authors  have  considered  the  graph  isomorphism 
problem  as  an  eigenvalue  problem  including  Harary  [12], 
Julius  and  Charmonman  [14]  and  Turner  [26],  In  September 
I960,  it  was  conjectured  by  Harary  [12]  that  two  graphs 
are  isomorphic  if  their  adjacency  matrices  have  the  same 
eigenvalue  spectra.  This  conjecture  was  proved  false 
by  counter-example  and  hence  has  been  withdrawn.  However, 
this  conjecture  has  been  verified  by  exhaustive  procedures 
for  graphs  with  up  to  6  nodes  (see  [12]). 

In  a  recent  paper  by  Turner  [26],  an  attempt  was 
made  to  characterize  graphs  up  to  isomorphism  by  considering 
a  ’more  powerful’  set  of  matrix  functions  called  immanents 
[15]  or  generalized  matrix  functions  [16].  However,  the 
efforts  in  this  direction  failed  and  two  examples  are 
given  of  non-isomorphic  graphs  whose  adjacency  matrices 
have  the  same  generalized  characteristic  polynomial  [26]. 


. 
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In  [14],  Julius  and  Charmonman  have  presented  a 
solution  to  the  complete  graph  isomorphism  problem  for 
undirected  graphs  which  have  distinct  eigenvalues.  The 
procedure  is  unique  in  that  it  depends  only  on  the 
eigenvalues  and  eigenvectors  of  the  adjacency  matrices. 
Moreover,  the  algorithm  requires  no  backtracking  or 
guessing  and  is  the  only  numerical  algorithm  encountered 
in  the  literature  survey.  A  complete  analysis  of  the 
algorithm  is  included  in  this  thesis  in  Section  3.1  of 
Chapter  III.  Unfortunately,  this  algorithm  has  not  been 
programmed  and  hence  no  estimate  of  the  efficiency  is 
available . 

1 . 2  Purpose  of  the  Study 

The  purpose  of  this  research  is  to  extend  the  numerical 
algorithm  of  Julius  and  Charmonman  to  include  graphs  which 
have  one  or  more  multiple  eigenvalues  and  to  program  and 
implement  the  extended  algorithm  on  an  IBM  S/36O/67 
computer  in  order  to  determine  its  efficiency. 


. 
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CHAPTER  II 


BASIC  THEORY 


2 . 1  Matrix  Theory 

In  this  section,  we  discuss  some  of  the  basic  definitions 
and  theorems  of  matrices  which  are  used  throughout  this 
paper.  The  theorems  are  stated  without  proof  as  the  proofs 
can  be  found  in  most  standard  texts  on  Linear  Algebra  or 
Numerical  Analysis  [8],  [17],  and  [20]. 

2.1.1  Notation  and  Definitions  Unless  otherwise 

specified,  upper-case  Latin  and  Greek  letters  denote 

matrices  and  lower-case  letters  denote  scalars.  We  say 

that  a  rectangular  matrix  A  =  (a^.)  with  m  rows  and 

n  columns  is  of  dimension  m-by-n.  If  m  =  n  ,  then  A  is 

square  and  of  order  n  .  The  identity  matrix  of  order 

n  is  designated  by  I  unless  there  is  ambiguity  in  which 

case,  it  is  designated  by  I  .  The  transpose  of  an 

arbitrary  matrix  A  is  denoted  by  A'  and  the  inverse 

of  an  arbitrary  non-singular  matrix  A  is  denoted  by  A-1  . 

t  h 

Given  a  matrix  A  of  dimension  m-by-n,  the  i  row 

is  designated  by  R. (A)  and  the  column  by  C.(A)  . 

1  J 

The  transpose  of  the  i ^  row  is  denoted  by  Rj(A)  and 

similarly,  the  transpose  of  the  j  column  is  denoted  by 

C’(A)  .  R* (A)  is  a  column  vector  of  mn  elements,  given 
J 


■ 


■ 
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(2.1) 


Rf ( A)  = 


R’ (A) 


R<~>  ( A) 


RT  (A) 
m 


and  C’(A)  is  a  row  vector  of  mn  elements,  given  by 


(2.2) 


C  ’  ( A )  =  [C*_(A),C^(A)#...,C^(A)] 


2.1.2  Matrix  Outer  Product  The  matrix  outer  product 
or  Kronecker  product  (Bellman  [2])  is  denoted  by  the  symbol 
®  and  is  defined  as  follows: 

Definition  2.1.  Given  two  matrices  A  and  B 
of  dimension  m-by-n  and  p-by-q ,  respectively ,  the  outer 
product ,  A  ®  B  ,  is  of  dimension  mp-by -nq  and  is  given  by 


(2.3) 


allB 

a12B 

tl  •  • 

a  In 

a21B 

a22B 

•  •  • 

a2n 

amlB 

am2B 

•  •  • 

a 

mn 

9 


Theorem  2.1.  If  A3B3C  and  D  are  matrices 
such  that  the  matrix  equation 

(2.4)  A  =  BCD 

is  valid3  then  by  utilizing  the  matrix  outer  product3  we 
can  rewrite  (2.4)  as  a  system  of  simultaneous  linear 
equations  as  follows: 

(2.5)  R  '  (A)  =  \_B  0  D  '  ]J? '  (C)  . 

2.1.3  Kronecker  Delta  Function 

Definition  2.2.  The  Kronecker 

denoted  by  6  .  .  and  is  equal  to  one  if 

I'd 

otherwise. 

2.1.4  Orthogonal  Matrices 

Definition  2.3»  A  real  matrix 
is  called  orthogonal  if 

(2.6)  Q  '  =  Q'1 

Theorem  2.2.  If  A  is  a  real  symmetric  matrix 3 
then  its  matrix  of  eigenvectors  is  orthogonal . 


delta  function  is 
i=j  and  is  zero 


Q  of  order  n 


. 
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2.1.5  Permutation  Matrices  A  permutation  matrix 
(Wilkinson  [29])  is  defined  as  follows: 

Definition  2.4.  A  matrix  P  =  P  is 

1J  2*  3  n 

a  permutation  matrix  if 


(2.7) 


1  > 

< 

0  otherwis  e  , 


where  (a.  ,  }  .  .  .  a  )  is  some  permutation  of  (lJ2i..,Jn) 

A  permutation  matrix  has  the  property  that  every  row 
and  column  has  precisely  one  unit  element.  Furthermore, 
if  P  is  a  permutation  matrix,  then  P’  is  a  permutation 
matrix.  Moreover,  P  is  orthogonal,  that  is, 

(2.8)  P'  =  P-1 


and  P'P  =  PP’  =  I  .  Further  properties  of  P  are  that 
pre-multiplication  of  a  matrix  A  by  P  replaces  FL(A) 
by  R  (A)  and  post-multiplication  by  P*  replaces 

CL  • 

1 

C±(A)  by  Ca  (A)  . 

l 

2.1.6  Similar  Matrices  (Murdoch  [17]) 


Definition  2.5.  Two  matrices  A  and  B  are 
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similar  if  there  exists  a  non-singular  matrix  S  such  that 


(2.9)  B  =  S~2AS  . 

(2.9)  is  a  similarity  trans formation  and  S  AS  is  called 
the  transform  of  A  by  S  , 

Theorem  2 . 3  «  Similar  matrices  have  the  same 
eigenvalues .  That  ist  if  U  and  V  are  the  eigenvectors 
of  A  and  B  respectively ,  then 

(2.10)  AU  =  UA 

and 

(2.11)  BV  =  VA  , 

where  A  is  the  diagonal  matrix  of  eigenvalues . 

2 . 2  Graph  Theory 

Because  the  terminology  and  symbolism  pertaining  to 
graph  theory  has  not  yet  been  standardized,  this  section 
is  devoted  to  defining  the  terms  and  symbols  which  are  used 
throughout  this  paper.  The  majority  of  the  definitions 
and  notations  are  taken  from  Busacker  and  Saaty  [4], 
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Since  geometric  graphs  may  be  considered  as  convenient 
representations  of  all  graphs  [4],  a  graph  is  defined  as 
follows : 

Definition  2.6.  A  graph  consists  of  a  non-null 
set  of  points  (nodes,  vertices)  V  in  Em  ,  interconnected 
by  a  set  of  simple  curves  (edges,  branches)  E  ,  which 
may  be  empty . 

A  graph  is  referred  to  as  G  =  (V,E)  or  simply  G  and 
if  the  set  V  has  n  elements,  n  >  0  ,  then  G  is  an 
n-node  graph. 

An  undirected  graph  (graph)  is  one  in  which  the  edges 
have  no  associated  direction  or  orientation.  A  directed 
graph  (digraph)  is  a  graph  where  each  edge  has  a  specific 
orientation.  In  this  case,  the  edges  will  be  referred  to 
as  arcs .  A  digraph  will  be  denoted  by  D  =  (V,A)  and  for 
every  D  ,  there  is  an  associated  undirected  graph  G  =  (V,A) 
which  is  obtained  from  D  by  ignoring  the  orientation  of 
the  arcs. 

If  e  is  an  edge  with  end-points  v  and  w  ,  then 
e  is  said  to  be  incident  with  nodes  v  and  w  and  the 
nodes  v  and  w  are  incident  with  edge  e  .  Two  vertices 
are  said  to  be  adj  acent  if  they  are  joined  by  an  edge  (or 
arc)  e  .  Similarly,  e^  and  are  adjacent  edges  (or 


arcs)  if  they  have  at  least  one  common  end-point.  A  loop 


- 
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is  an  edge  e  with  end-points  v  and  w  where  v  =  w  . 
Two  edges  in  a  graph  are  said  to  be  parallel  if  and  only 
if  they  have  the  same  end-points.  In  a  digraph,  two  arcs 
are  parallel  if  they  have  the  same  end-points  but  opposite 
orientation  and  are  strictly  parallel  if  the  orientation 
is  the  same. 

A  simple  graph  is  a  graph  that  contains  no  loops  and 
no  parallel  edges;  and,  a  complete  graph  is  one  in  which 
every  pair  of  distinct  vertices  are  adjacent. 

We  can  formally  define  isomorphism  between  graphs  as 
follows : 

Definition  2.7.  Two  graphs ,  G  =  (V3E)  and 
G*  =  (V*j E * )  ,  are  isomorphic  to  each  other  if  there  exists 
a  one-to-one  correspondence ,  $  ,  between  V  and  V*  and 

between  E  and  E*  that  preserves  incidences . 

That  is,  if  $(v)  =  v*  and  $(e)  =  e*  then  edge  e  is 
incident  with  vertex  v  in  G  if  and  only  if  e*  is 
incident  with  vertex  v*  in  G*  .  If  G  is  isomorphic 
to  G*  ,  we  will  write  G  -  G*  ,  otherwise,  G  /  G*  .  Two 
digraphs  are  said  to  be  isomorphic  if  their  associated 
undirected  graphs  are  isomorphic  and  each  pair  of  corres¬ 
ponding  arcs  are  oriented  the  same  way. 

A  graph  or  digraph  is  completely  specified  by  its 
adjacency  (connection,  vertex)  matrix  which  is  defined 


as  follows: 
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Definition  2.8.  Let  the  matrix  A  of  order  n 

be  associated  with  the  n-node  graph  (digraph)  G  .  If  the 

rows  and  columns  of  A  correspond  to  the  nodes  of  G  , 

then  define  a.  .  to  be  equal  to  the  number  of  edges  (arcs) 

'iC 

joining  the  nodes  i  and  (to)  j  .  The  matrix  A  is  said 
to  be  the  adj acency  matrix  of  graph  G  . 

It  should  be  noted  that  if  G  is  simple,  then  the  elements 
=  1  or  0  for  all  i  and  j  .  Also,  if  a  digraph 
D  has  no  parallel  or  strictly  parallel  arcs  and  if  A  is 
the  adjacency  matrix  of  D  ,  then  the  adjacency  matrix  of 
the  associated  undirected  graph  is  given  by  the  Boolean 
sum  of  A  and  A’  . 

2 . 3  Special  Operators 

In  this  section,  we  define  two  special  operators  which 
are  used  in  the  development  of  the  graph  isomorphism 
algorithms  in  Chapter  III. 

Definition  2.9°  The  superscript  +  will  be  used 
instead  of  the  standard  division  operator  when  the 
denominator  can  assume  all  real  values  including  zero. 

The  operator  is  defined  as  follows: 


a^O 


J 


(2.12) 


0 


a=0 
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Definition  2.10.  The  binary  operator  ~  is  to 
be  interpreted  to  mean  ' does  not  disagree  with '  and 
0  ~  ±u,  +a  ~  +a3  -a  ~  -a  +a  /  -a  ,  where  a  is  any 

real  number.  When  this  operator  is  used  with  vectors  as 
arguments ,  we  apply  the  operator  to  the  corresponding 
elements  in  each  vector. 

2 . 4  Graph  Isomorphism  Problem 

In  this  section,  we  formulate  the  graph  isomorphism 
problem  as  an  eigenvalue  problem. 

Since  the  nodes  of  an  n-node  graph  may  be  labelled 
in  n!  different  ways,  an  unlabelled  n-node  graph  G  may 
be  represented  by  up  to  n!  different  adjacency  matrices. 
If  we  associate  the  integers  l,2,...,n  with  the  nodes 
of  G  ,  then  the  n!  ways  of  labelling  G  correspond 
to  the  n!  permutations,  (a^  ,012 ,  .  .  .  ,ot  )  ,  of  the  integers 
l,2,...,n  ,  It  follows  from  Definition  2.7,  that  two 
graphs,  G  and  G*  ,  are  isomorphic  if  and  only  if  they 
are  differently  labelled  versions  of  the  same  graph. 
Furthermore,  since  graphs  are  completely  specified  by  their 
adjacency  matrices  and  if  A  and  B  are  the  respective 
adjacency  matrices  of  G  and  G*  ,  then  the  problem  of 
determining  whether  or  not  G  -  G*  is  essentially  that  of 
determining  whether  or  not  A  and  B  represent  differently 
labelled  versions  of  the  same  graph. 


. 


- 
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If  G  -  G*  ,  then  there  exists  a  permutation, 

(a1,a2 , • • • san)  ,  such  that  node  i  of  G  corresponds 
to  node  of  G*  .  Since  the  rows  and  columns  of  the 

adjacency  matrices,  A  and  B  ,  correspond  to  the  nodes 
of  G  and  G*  ,  we  see  that  by  permuting  the  labels 
(or  subscripts)  of  the  nodes  results  in  permuting  the 
corresponding  rows  and  columns  of  the  adjacency  matrix. 
Hence,  if  P  is  the  permutation  matrix  given  by  (2.7) 
corresponding  to  the  permutation  ( , . . . , )  ,  then 
the  similarity  transformation,  PBP'  ,  results  in  permuting 
the  labels  of  the  nodes  of  the  corresponding  graph.  That 


is, 

if  B  is 

the  adjacency  matrix 

of 

G*  , 

then  FL  (  PBP  1  ) 

and 

Ci(PBP?  ) 

correspond  to  node 

of 

G*  .  Therefore 

if 

A  and  B 

are  the  respective 

adj  acency 

matrices  of 

G  and  G#  ,  then  the  graph  isomorphism  problem  can  be 
reformulated  as  an  eigenvalue  problem  as  follows: 

Definition  2.11.  G  -  G*  if  and  only  if  there 

exists  a  vermutation  matrix  P  =  P  (Definition 

al3  a2J  *  *  *  *  an 

2.4)  suoh  that 

(2.13)  A  =  PBP '  . 

Moreover,  since  A  and  B  are  similar,  we  have,  from 
Theorem  2.3,  the  necessary  condition  that  the  eigenvalues 
of  A  and  B  must  be  identical. 


CHAPTER  III 


ANALYSIS  OF  A  NUMERICAL  ALGORITHM  TO 
DETERMINE  GRAPH  ISOMORPHISM 

In  this  chapter,  we  present  the  analysis  of  a  numerical 
algorithm  to  determine  graph  isomorphism  for  the  special 
case  where  the  adjacency  matrices  have  distinct  eigenvalues 
and  the  general  case  where  the  adjacency  matrices  may  have 
one  or  more  multiple  eigenvalues. 

3 . 1  Analysis  of  the  Algorithm  for  Distinct  Eigenvalues 

The  algorithm  described  in  this  section  was  developed 
by  R.S.  Julius  and  S.  Charmonman  [14],  Their  analysis 
is  presented  here  since  the  extension  of  the  algorithm 
to  include  multiple  eigenvalues  is  a  generalization  of 
their  algorithm  for  distinct  eigenvalues. 

3.1.1  Preliminary  Analysis  Let  A  and  B  be  the 
adjacency  matrices  of  the  simple  n-node  graphs  G  and  G*  , 
respectively.  If  G  -  G#  ,  then  from  (2.13)  A  and  B 
are  similar.  Therefore,  if  A  is  the  diagonal  matrix  of 
distinct  eigenvalues  and  U  and  V  are  the  matrices  of 
eigenvectors,  normalized  to  unit  length,  of  A  and  B  , 
then  Theorem  2.3  gives 


(3.1) 


AU  =  UA 


' 
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and 


(3.2) 

BV  =  VA  . 

By  combining 

(2.13),  (3.1)  and  (3.2),  we  obtain 

(3.3) 

PV  =  UD  , 

where  D  is 

a  diagonal  matrix  with  d^  =  ±1  ,  i  =  l,2,...,n 

Solving 

(3*3)  for  P  yields 

(3.4) 

P  =  UDV” 1  , 

2 

which  gives  us  n  equations  relating  the  elements  of  P 
to  those  of  D  .  By  Theorem  2.1,  (3.4)  can  be  rewritten  as 


(3.5) 

H  =  [U  ®  (V-1) » ]f 

where 

(3.6) 

R  =  R ’ (P) 

and 

(3.7) 


f  =  R ’ (D  )  . 
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Since  the  vector  f  consists  of  the  transposed  rows 
of  the  diagonal  matrix  D  ,  it  has  non-zero  elements  only 
in  positions  (j-l)n  +  j  ,  j=l,2,...,n  ,  thus  only  these 
n  columns  of  U  ®  need  be  considered.  Therefore, 

we  can  rewrite  (3-5)  as 

(3.8)  R  =  Kd  , 

2  - 1 
where  the  n  -by-n  matrix  K  is  obtained  from  U  ®  (V  ) ’ 

by  deleting  all  but  the  (j-l)n  +  j  ,  j=l,2,...,n  , 

columns,  and  the  elements  of  d  are  d.  =  (D)..  ,  j=l,2,...,n 

J  J  <3 

If  we  partition  K  into  n  submatrices,  , 

i=l,2,...,n  ,  of  order  n  ,  we  can  write  (3.8)  as  n 
systems  of  equations  as  follows: 

(3.9)  R! (P)  =  K.d  ,  i=l , 2 , . . . ,n  . 


The  matrices  are  given  by 


(3.10)  K±  =  [u^RpV"1),  u.2R^(V"1),...,ulnR^(V'1)]  , 
for  i=l , 2 , . . . ,n  . 

Using  (3-9)  a  we  can  determine  the  n  rows  of  P  and 
the  method  we  use  depends  on  whether  or  not  all  of  the 
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are  singular.  From  (3.10),  it  is  easily  seen  that  since 
is  composed  of  multiples  of  the  transposed  rows  of 
the  non-singular  matrix  V"""L  ,  is  singular  if  and 

only  if  FL(U)  has  one  or  more  zero  elements. 

3.1.2  Non-Singular  Procedure  If  we  assume  that  at 

least  one  row  of  U  ,  R  (U)  ,  has  all  non-zero  elements 

s 

then  the  s^*1  set  of  equations  in  (3.9)  can  be  solved 
explicitly  for  d  giving 


(3.11) 


d  =  K  1  R» (P)  . 

s  s 


The  non-singular  procedure  is  obtained  by  substituting 

(3.11)  in  (3.9),  which  gives 

(3.12)  Rj(P)  =  Kj_  K"1  Rg  ( P )  ,  1-1,2,. ...n  . 

Since  P  is  a  permutation  matrix,  R  (P)  must  be  one  of 

s 

the  unit  row  vectors  e^  ,  j  =  l,2,.„.,n  ,  where  (e^.)^  = 

If  we  let  be  the  matrix  whose  s1"*1  row  is  e^  ,  then 

(3.12)  becomes 


Ri(V  - 


W;1) 


1=1,2, 


,n 


(3.13) 


•  9  • 
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Combining  equations  (3.10)  and  (3-13)  results  in 


(3.14) 


n  u 


l 


ik 


,  ,  u  , 
k=l  sk 


Vtk(v_1)kj  • 


1  >  j  » 1  1 » 2  ,  .  .  .  ,n  • 


The  n  matrices  generated  by  (3.14)  must  be  tested  to 
determine  whether  or  not  they  are  permutation  matrices. 


3.1.3  Singular  Procedure  If  all  of  the  are 

singular,  then  there  is  at  least  one  zero  column  in  each 

K.  .  If,  for  i=s ,  C.(K  )  =  0  ,  then  R  (P)  does  not 
i  j  s  s 

t  h 

depend  on  d.  .  Thus,  in  the  s  set  of  equations  (3.9) 

J 

we  can  set  d^  to  zero  without  destroying  the  equality. 
Subsequently,  we  will  interpret  dj  =0  to  mean  dj  is 
not  defined. 

If  we  define  the  n  matrices  of  order  n  to  be 


(3.15) 


Li  ■ 


uii  ci(v) 


ui2  C2(V) 


uin  CA(V) 


y  i  1 5 2  5  .  3n  3 


then  from  (3.10)  and  (3.15)  it  can  be  easily  verified  that 
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L^K.  s  1=1,2,... ,n  ,  differs  from  I  in  that  (L.K.)..  =  0 
If  and  only  if  C.  (Ki)  =  0  .  Similarly,  (L^d)^  =  d. 
when  Cj(K^)  ?  0  ,  and  (L^K^d)^  =  0  when  Cj(K^)  =  0  . 
Consequently,  multiplying  (3.9)  on  both  sides  by  gives 


(3.16) 


( L .  R !  ( P ) )  .  =  d  or  0 

J  J 


i  ,  j  =  1 , 2 ,  .  .  .  ,  n 


However,  since 


Ri(P) 


=  e 


for  some  j  ,  we  have 


(3.17) 


L.R’(P)  =  C.(L±) 


and  if  R. (P)  =  e  and  R.(P)  =  e,  then  from  (3.16)  and 
is  J  z 

(3.17)  we  must  have  that  C  (L. )  ~  C,(L.)  .  Moreover, 

si  z  J 

from  (3.16)  the  elements  of  C  (L. )  and  C,(L.)  must 

si  z  J 

be  ±1  or  0  . 

Thus  the  singular  procedure  consists  of  generating 
the  n  matrices  from  (3.15)  and  then  searching  for 

n  columns,  one  from  each  ,  that  satisfy  the  following 


conditions : 


' 


* 
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1)  C  (L, )  ~  C  ( L0 )  ~  ...  ~  C  (L  ) 
a,  1  a0  2  a  n 

12  n 


2)  j-  aj  for  i  t  j 


(3.18) 


3)  (Ca  (L1))J  =  ±1  or  0  ,  l,j=l,2,...s 


n 


4)  If  ( C  (L, )),  =  0  ,  then  (L, ),v  =  0  , 

A.  J  ±  J  iv 


for  k=l , 2 , . . .  ,n  . 


Every  set  of  columns  satisfying  (3.18)  yields  a  matrix 
given  by 


(3.19)  R.(P)  =  e  ,  1*1,2, . . . ,n 


which  is  a  permutation  matrix  satisfying  (2.13).  If  no 
set  of  columns  exists  that  satisfies  (3.18),  then 
A  j-  PBP’  and  hence  G  /  G*  . 

It  should  be  noted  here  that  the  singular  procedure 
is  more  general  than  the  non-singular  procedure  and  may 
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be  used  even  if  not  all  of  the  K.  are  singular. 

3 . 2  Analysis  of  the  Algorithm  for  Multiple  Eigenvalues 

In  this  section,  we  develop  the  extension  of  the 
algorithm  presented  in  Section  3.1  to  include  the  case 
where  the  adjacency  matrices  have  multiple  eigenvalues. 

Since  the  algorithm  for  multiple  eigenvalues  is  a 
generalization  of  the  singular  procedure  discussed  in 
Section  3.1,  It  may  be  used  for  the  case  where  the  eigen¬ 
values  are  distinct. 

3.2.1  Preliminary  Analysis  Let  A  and  B  be 
the  adjacency  matrices  of  the  n-node  graphs  G  and  G*  . 

If  G  -  G*  and  U  and  V  are  the  matrices  of  ortho- 
normalized  eigenvectors  of  A  and  B  ,  then  (2.13),  (3.1) 
and  (3.2)  are  still  valid.  Let  A  have  p  distinct 
eigenvalues,  A ^  ,  i=l,2,...,p  ,  with  multiplicity  n^  , 
i=l,2,...,p  ,  and  assume  that  the  X ^  are  ordered 
according  to  increasing  multiplicity,  that  is,  ru  <  n^+1  , 
i=l , 2 , . . . , p-1  .  Equations  (3-3)  and  (3.4)  still  hold 
but  since  we  have  multiple  eigenvalues,  an  eigenvector  of 
A  corresponding  to  A^  with  multiplicity  n^  is  no 
longer  a  permutation  of  one  eigenvector  of  B  but  may  be 
a  permutation  of  a  linear  combination  of  all  the  eigen¬ 
vectors  of  B  that  correspond  to  A^  .  Therefore,  D  is 
no  longer  strictly  diagonal  but  is  block  diagonal  of  the  form 
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(3.20) 


‘1 


A, 


D  = 


0 


0 


A 


where  the  p  submatrices  A^  are  of  order  and 

give  the  explicit  linear  combination.  Equation  (3.5), 


(3.5) 


R  =  [U  ®  (V"1) ' ]f  , 


still  holds  where  R  and  f  are  given  by  (3.6)  and  (3.7), 
but  since  D  is  block  diagonal,  the  column  vector  f  is 
of  the  form 


ft  = 


[R1(A1),0],[R2(A1),0],. . . ,[Rn  (A1),0], 


(3.21) 


[0,R1(A2),0],...,[0,R  (A  )] 

P  P  - 


Deleting  the  columns  of  U  ®  (V  ^)’  corresponding 


to  zero  elements  of  f  ,  we  can  rewrite  (3*5)  as 
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(3.22) 


where 


(3.23) 


and  K 


K 


(3.24) 


R  =  Kd 


d  is  a  column  vector  with  l  n.  elements  given  by 

i  =  l  1 


d  T  =  [R1(A1)  ,R2(A1)  ,  .  .  .  ,Rn  (A^^)  , 


R1(A2) ...... ,Rn  (A  ) ] 


2  ^2 

is  of  dimension  n  -by-  l  n.  given  by 

i  =  l 


■  ■ 


[C1(U),C2(U),...,Cn  (U)]  ®  [C1((V"1) ' ) ,C,( (V-1) ’ ) , 


•  •  •  -c^cv"1) '  )],[Cni+1(U),  . . .  ,cni+n2(0)] 


8  CCn1+l((V"1),)-----Cni+n2((V"1),)]* 


o  •  c 


j [ cn-n  +1(U),...]  ®  [...,Cn((V  1) * ) ] 
P 
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Partitioning  K  into  n  submatrices,  we  have 


(3.25) 


R!_(P)  =  K.d  ,  i  =  l,2 


3 


where  the  are  given  explicitly  by 


K 


i 


u  2  3  * 


] 


(3.26)  ®  [C1((V"1)-»  ),...  ,C  ((V-1)’)], 

±  n! 


,  [u .  ®  [ 

J  i.n-n  +1* 

J  P 


,C  ((V 

>  n 


-1 


)'  )] 


o 


for  i=l , 2 , . . . ,n  . 

If  we  now  define  the  n  matrices  to  be 
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we  can  multiply  both  sides  of  (3.25)  by  to  obtain 

the  equation 


(3.28) 


L1R' (P) 


L.K.  d 


i  i 


a  1,2,  ... ,n  o 


Multiplying  (3.26)  by  (3.27)  yields 
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(3.29)  L.Ki  = 


m.2  0 


0 


M, 


ip 


j  i  1 , 2  ,  .  .  .  ,n  , 


which  is  block  diagonal  and  the  submatrices  IVL^  are  of 
2 

order  n^  .  Furthermore,  IVL^.  ,  k=l,2,...,p  ,  may  be 
written  as 


(3.30) 


®  I 


j 


for  k=l,2,...,p;  i=l,2,...,n  ,  where  m.^  is  given  by 
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and 


k-1 

(3.32)  t  =  y  n.  . 

j-1  J 


If  d  is  written  in  the  form 


(3.33) 


R'  (Ax) 

R  ’  ( A  g  ) 
0 

R'(Ap) 


then 


(3.3^) 


L.K.d  = 

l  l 


Mj_  ]_R  *  (  A  ]_ ) 


M12R» (A2) 


M.  R'  ( A  ) 

ip  p' 


,  i=l,2, . . . ,n 


Now,  from  (3-30),  (3.31)  and  (3*3^),  for  a  fixed  k  we  have 
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(3.35) 


MikR'(V  ■ 


Rl(mik)cl(V 


Rl(mlk)C2(V 


Rl(mik)Cnk(Ak} 


R2(raik)Cl(Ak) 


Rnk(raik)Cnk(Ak) 


and  from  (3.27)  and  (3.28), 


(3.36) 


MikR'(Ak) 


u 


u 


i<t  n 

+ 

i,t  +  2 


i,t+nk 


RJ(P) 


Combining  (3-35)  and  (3*36),  the  equations  for  Cj(Ak)  , 

<j  —  1  j  2  j  •  •  •  )  n,  j 


are 
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(3'37)  ui,t+sCt+j(V)Ri(P)  “  Rs(mik)Cj(Ak) 


s  1,2, ... ,n. 


where  t  is  given  by  (3-32).  For  a  given  j  ,  (3.37) 
gives  n^.  equations  for  C  .  (A^.)  which  differ  from  each 
other  by  a  constant  multiplier,  which  may  be  zero. 

Therefore,  we  need  to  choose  a  non-null  set  of  equations 
for  j =1 , 2 , . . . ,n^  in  order  to  solve  for  . 

If  we  de.fine  an  array  Q  of  dimension  n-by-p  such  that 


t  +  r  ,  if  uijt+J=0,  j  =  1 , 2  , .  .  .  ,r-l,  t+r?*0 


(3.38)  q.k  =  { 


t+n^ ,  if  u±  t+.  0,  j  1,2,..., 


n 


k 


b-  1,2,.  ».,p  ,  _L  l,2,o..,  ic  , 


where  t  is  defined  by  (3.32),  then  by  deleting  all  rows 

of  L.  except  those  corresponding  to  u.  ,  k=l,2,...,p  , 

1  1,qik 


we  obtain 
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(3.39) 


L.  = 

l 


Ui  q  Ci(V) 

1,qil 


Ui  q  C2(V) 


u 


i,q 


il 


C’  (V) 
nl 


u.  C'(V) 

i  ,q .  nv 

,Hip 


,  1*1,2,. 


•  >n  , 


which  is  of  order  n  .  Then  (3.28)  reduces  to 


(3.40)  L.Rj(P)  =  LiK.d  = 


R(q11)-t1(mil)Cl(Al) 


R(q11)-t1(mil)Cn1(Al) 


R(q12)-t2('mi2')Cl('A2^ 


R,  ,  .  (m.  )C  (A  ) 

(qip)_tp  lp  np  p 


for  1=1, 2 , . . , ,n  , 
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where 


k-1 

(3.4l)  t  =  0  ,  t  =  l  n.  ,  k=2 , 3 > . . . , p  . 

K  i=i  1 

Therefore,  for  a  given  k  ,  by  choosing  a  set  of 

n,  i's  ,  Yt  • • • jY  ,  such  that  R,  N  ,  (m  ,  )  , 

k  *  '  1  *  1  2  *  * 'n,  *  (q  ,  )-t,  Y.k  J 

k  . , k  k  1 j 

J 

j=l,2,...,n^  ,  are  linearly  independent,  we  can  solve 
(3*40)  for  by  choosing  a  set  of  unit  row  vectors 

for  n^.  rows  of  P  .  For  example,  if  k=l  ,  we  obtain 
the  equations 


(3.42) 


R,  x  f  (in  .  )C.  (i  ) 

(qY1,l)  1  Y1  ° 


=  (L  R’  (P) ) . 

y  i  y±  3 


R(qY 

1  2  > 1  ^ 


(L  R»  (P)). 

y2  y2  J 


»  J  1 , 2  , .  .  .  ,  n. 


R 


(q 


Y 


n. 


)-t  (mv 
1;  rl  Y 


n. 


1 )  C  j  ( A  i ) 


=  (L 


Y 


n 


R' 

Y 


(P)) 


1 


n 


1 


Since  the  matrix  of  coefficients  on  the  left-hand  side  of 

(3.42)  is  independent  of  j  ,  we  can  write  (3.42)  as  a 
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matrix  equation  as  follows 


R(a  )-t  (mv  1) 

^qY1,l;  1  yl 

R  (P)L'  , 

Y1  U1 

(3.43) 

R/  n  .  (m  ,  ) 

(qY2,l)-tl  Y21 

• 

• 

ii 

i — i 

o 

R  (P)L'  , 

y2  y2i 

• 

• 

• 

R(a  )-t  (mY  f 

UY  ,1;  1  Yn/ 

'  n.^  *  1 

\  (p)U;  i 

ni  ni 

where 


(3.44) 


L !  . 
ij 


"  [Ct.+l(Li}>  Ct. 
J  J 


+2(L!) 


vVEi)] 


In  general,  we  choose  n^.  y  ’  s  such  that 
R/  )  t  *  J=1> 2 > • • • >nk  ,  are  linearly  independent 

^qYj,k;  k  Yj 

and  solve  the  system 


■ 
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(3.45) 


R<%>k)-tk(DV) 

R  (P)L’  . 

Y !  Yxk 

R(qY2,k)-tk(mY2k) 

0 

0 

• 

II 

< 

R  (P)L'  , 

Y2  Y2k 

• 

• 

• 

R(qY  k)_tk(mYn  k) 

Yn  >K  K  nk 

R  (P)L'  , 

Y  y  k 

'  n,  1  n, 

k  k 

by  choosing  unit  row  vectors  for 


R  (P) 
*i 


i=l,2. 


k  ‘ 


If  we  define  the  matrix  M  of  order  n  to  be 


(3.46) 
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o' 
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o' 
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r— i 
CM 
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4-  H 
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4-  CM 
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o* 
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ii 

IS 


38 


and  consider  M  to  be  partitioned  into  p  submatrices, 

M.  ,  of  dimension  n-by-n .  where 

(3.47) 

M  =  [Ct  +1(M),Ct  +2(M),...,Ct  +n  (M)]  ,  j=l,2,...,p  , 

J  J  J  J  J 

and  t.  is  given  by  (3.41),  then  from  (3-31),  (3.38)  and 
J 

(3.46)  we  have 


(3.48) 


R/_  \  x-  ( m  ,  )  =  R 

(qYJk)-tk  V  \ 


(Mk) 


Hence,  (3.45)  may  be  rewritten  as 


VV 

R  (  P  )  L  ’  , 

Yx  Yxk 

(3.49) 

• 

• 

• 

II 

<] 

R  (P)L'  , 

y2  y2k 

0 

• 

Ry  <Hk> 
nk 

R  (P)L»  | 

Y  y  k 

'  n,  '  n, 

k  k 
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Since  the  matrices  of  eigenvectors  U  and  V  of 
real  symmetric  matrices  are  orthogonal  (Theorem  2.2),  we 
have  from  (2.6)  and  (3.3)  that 

(3.50)  D  =  U'PV 

and  hence  from  Theorem  2.2  and  equation  (2.8), 

(3.51)  D'D  =  I  . 

Combining  (3.20)  and  (3.51)  gives  us  a  necessary  condition 
that  A^  must  satisfy 

(3.52)  A’Ai  =  I  ,  1=1,2,. . . ,p  . 

Therefore,  if  n^  rows  of  P  are  chosen  and  A^A^  ^  I 

k 

then  we  must  change  our  choice  of  unit  vectors  for  these 
n,  rows  of  P  .  If,  however,  A'A,  =  I  ,  then  that 

K  K 

particular  choice  of  n^  rows  of  P  may  yield  a 
permutation  matrix  that  satisfies  (2.13). 

If  m  .  n  <m<n  ,  rows  of  P  need  be  chosen  in  order 
to  compute  A^  ,  k*l,2,...,p  ,  and  if  these  m  rows  yield 


. 


aolorio  u  J.U-  1  ' 

.  ' 
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p  A^’s  such  that  (3.52)  is  satisfied,  then  we  ultimately 
obtain  a  permutation  matrix  P  that  satisfies  (2.13). 

If  n^  rows  of  P  have  been  chosen  and  , 

k=l,2,...,i  ,  have  been  computed  satisfying  (3.52),  we 
can  utilize  a  modification  of  (3.49)  to  determine  possible 
choices  of  unit  row  vectors  for  subsequent  rows  of  P 


that  must  be  chosen.  Let  us  assume  that  R  (P) 


j 


j=l,2,...,ni  ,  have  been  chosen  and  A^  ,  k=l,2,...,i  , 
computed.  Furthermore,  we  assume  that  A^  ,  k=l,2,...,i  , 


satisfies  (3.52)  and  that  for  some  k  ,  R  (P)  ,  Yi  ?  Y* 

Ylr  K  J 


j =1 , 2 , . . . ,n .  ,  must  be  chosen  in  order  to  compute  A1  +  1  . 

If  there  exists  a  permutation  matrix  P  satisfying  (2.13) 
that  corresponds  to  our  choice  of  unit  vectors  for 
R  (P)  ,  j=l,2,...,n.  ,  then  from  (3.38),  (3.46)  and 

yj 

(3.49)  we  must  have 


[R  (M  ),R  (M  ) 
'  k  1  Yk 


2' » *  ’  * » 


R  (M  )]  A 
Tk 


A 


0 


2 


(3.53) 


0 


A 


i 


If  e  ?  R  (P)  ,  J-1,2 
1  YJ 


for  some  t  . 


•  t  • 


for  the  set 


. 

> 

(£**.£)  lo  noI^Bollibora  jq:  ssjtl.i'.u  r.to 

■;  c;.  •  •  .  I  .  S  '  ...  .  ,  ,  ' ....  i  =  l 

bns  ( S £ .  £ )  as tri  e  2  .'la  8 
isum  <  n, , . . tS  X* l 

- 

t 


i-ll 


of  t's  which  satisfy  (3.53),  then  the 

choices  of  unit  row  vectors  for  R  (P) 

Yk 


only  possible 
,  based  on  our 


previous  assumptions,  are 


(3.51!)  R  (P)  =  e.  . 

Yk  c 

Thus,  we  can  use  (3.53)  to  determine  future  choices 

for  R1(P)  and  hence,  reduce  the  degree  of  arbitrariness 

in  the  algorithm.  If  however,  (3.53)  does  not  hold  for 

some  t  ,  then  no  permutation  matrix  exists  corresponding 

to  our  choice  of  unit  row  vectors  for  R  (P)  ,  j=l,2,...,n. 

Yj 

3.2.2  Procedure  for  Multiple  Eigenvalues  The 
numerical  algorithm  for  multiple  eigenvalues  consists 
firstly  of  generating  the  matrix  Q  according  to  (3-38). 
Secondly,  we  generate  the  n  matrices,  Lj  ,  of  order 
n  t  from 


[C1(v) 


,C  (v)],  u 


n 


iq 


i2 


CCn1+l(V) ’ '  "  3’ 


(3.55) 


Uiq.  0..,C  (v)] 
IP 


i— l,2,...,n  , 


.  .  .1 
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and  M  from  (3.46)  . 


From  M.  ,  we  choose  n  linearly  independent  rows , 
J  J 

R  (M.  )  ,  i=t  +l,t .+2 , . . . ,t .+n .  ,  for  j  =  1., 2  , .  .  ,  , p ,  and 

Y  ^  J  J  J  J  J 

call  these  p  submatrices,  which  are  of  order  n.  .  T.  . 

J  J 

j=l,2,...,p  .  Since  T.  is  precisely  the  coefficient 

J 

matrix  of  A.  in  (3.49),'  we  compute  TT1  ,  jfl,2,...,p  , 
J  J 


in  order  to  solve  for 


‘j  • 


The  procedure  then  consists  of  selecting  a  set  of 

n-,  unit  row  vectors  for  R  (P)  ,  i=l,2,...,n,  ,  and  com- 

Yi 

puting  from  (3.49)  until  (3.52)  is  satisfied.  Then, 

if  necessary,  determine  possible  choices  for  R  (P)  , 

Yi 

i=t  .+1  ,t  .  +  2  , .  .  .  ,t  +n  .  ,  using  (3.53)  and  (3-54)  and  compute 
J  J  J  J 

A.  ,  j=2,3,  .  .  .  ,p  .  For  each  j  ,'  if  (3.52)  holds,  then 
J 

we  proceed  to  compute  Aj+j  in  same  manner.  If, 

however,  (3-52)  is  not  satisfied,  or  (3.52)  is  satisfied 

and  (3.53)  and  (3-54)  do  not  hold,  then  we  must  change  our 

selection  of  unit  vectors  for  R  (P)  ,  i=t . +  1 , t  . +2  , . . .  , 

Yj_  J  j 


t.+n.  .  and  re-calculate  all  A.  .  l^i^j  , 
J  J  i  5  J  ’ 

computed  from  the  previous  selection. 


which  were 


When  all  A^  ,  i=l,2,.,.,p  ,  have  been  computed 
satisfying  (3.52)  for  a  given  set  of  unit  vectors  for  m 


rows  of  P  ,  we  generate  all  permutation  matrices  based 
on  this  selection  using  (3-53)  and  (3.54).  The  algorithm 
then  consists  of  backtracking  and  changing  our  selection 

i 

of  unit  row  vectors  until  all  permutation  matrices  are 


. 


- 

1  >.'0  bi.fi  Aobi  Wo&cl  *io  at 
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ultimately  generated  satisfying  (2.13). 

If  at  least  one  P  is  generated  by  the  algorithm, 
then  G  -  G*  and  if  no  P  is  generated,  then  G  t  G*  . 
Moreover,  if  no  set  of  unit  row  vectors,  e^  ,  for  m 
rows  of  P  exists  such  that  (3.52)  holds  for 
i=l,2,...,p  ,  then  G  ^  G*  .  Hence,  the  algorithm  for 
multiple  eigenvalues  halts  in  one  of  two  states 
indicating  whether  or  not  G  -  G*  . 


: 

n 


CHAPTER  IV 


NUMERICAL  EXPERIMENTS 

The  numerical  algorithm  for  determining  graph 
isomorphisms  described  in  Section  3-2  of  Chapter  III 
was  programmed  in  Fortran  IV  source  language  (see 
Appendix)  and  tested  successfully  on  the  IBM  360/67 
computer  installation  at  the  University  of  Alberta.  In 
an  attempt  to  determine  the  efficiency  of  the  algorithm, 
several  types  of  graphs  were  used  as  test  data  and  the 
program  was  timed  using  an  assembly  language  subroutine 
CS019A,  provided  by  the  Computing  Centre,  which  accesses 
the  OS/36O  interval  timer. 

4 . 1  Test  Data 

The  test  data  consist  of: 

i)  Isomorphic  graphs  with  distinct  eigenvalues; 

ii)  Isomorphic  graphs  with  multiple  eigenvalues; 

iii)  Non-isomorphic  graphs  with  different  eigenvalues;  and, 

iv)  Non-isomorphic  graphs  with  identical  eigenvalues. 
Several  graphs  of  these  four  types  are  presented  in 
Tables  4.1,  4.2,  4.3  and  4.4.  Their  corresponding  adjacency 
matrices  are  not  given  as  they  can  be  obtained  from  the 
graphs  by  using  Definition  2.8.  For  example,  the  complete 
graph  with  3  nodes  and  its  corresponding  adjacency  matrix 


, 

' 

¥  . 

d  .j  .  w 

3  cfljjfl,  Irfiw  3i  qjsis  oJtfl.  .:o;i  3  8l 
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is  given  in  Figure  4.1. 


Oil 
10  1 
1  i  0_ 
G  A 

Figure  4.1  The  Complete  3-Node  Graph 


4.1,1  Isomorphic  Graphs  with  Distinct  Eigenvalues 
Since  the  procedure  for  multiple  eigenvlaues  is  a 
generalization  of  the  singular  procedure  for  distinct 
eigenvalues,  the  algorithm  for  multiple  eigenvalues  may 
be  used  to  determine  isomorphisms  between  graphs  with 
distinct  eigenvalues.  Consequently,  four  graphs,  G^  , 

G^  ,  G^  and  G^  ,  with  distinct  eigenvalues  are  used 
as  test  data.  G|  ,  G^  and  G^  are  differently  labelled 
versions  of  G^  ,  G^  and  G^  .  G^  and  G^  are  taken 
from  [14],  G^  is  a  modified  undirected  graph  corres¬ 
ponding  to  the  directed  graph,  G  ,  in  Figure  2.1  in  [24] 
and  G^  and  Gjj  are  modified  undirected  graphs 
corresponding  to  the  directed  graphs ,  G^  and  G^  ,  in 
Figure  3.2  in  [24],  The  modified  undirected  graphs  are 


3djB 
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obtained  by  deleting  all  parallel  edges  from  the  associated 
undirected  graphs  of  the  corresponding  directed  graphs. 


Tab le  4 . 1 

Isomorphic  Graphs  with  Distinct  Eigenvalues 
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4.1.2  Isomorphic  Graphs  with  Multiple  Eigenvalues 
The  graphs  G^  ,  1=5,6,... ,19  have  multiple  eigenvalues 
and  the  eigenvalues  of  G|  are  identical  to  those  of 
G^  .  ,  G^  and  Gg  are  differently  labelled  versions 

of  G^  ,  Gg  and  Gg  ,  while  G^  and  G*  are  identical 
to  G^  and  G^  respectively.  G^  is  the  associated 
undirected  graph  of  the  digraph  given  in  Figure  5  in 
[27].  The  graphs  G^  and  G?  ,  i=10 , 11 , . . . , 19  ,  are 
the  complete  graphs  with  3,4,5,6,7,10,15,20,25  and  30 
nodes  respectively. 


Table  4.2 

Isomorphic  Graphs  with  Multiple  Eigenvalues 


Table  4.2  (Continued) 


10-19 


13,4,5,6, 

7,10, 15J 
20,25, 
30 


Complete  Graph 
with  n  nodes 
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4.1.3  Non-Isomorphic  Graphs  with  Different  Eigen¬ 
values  G^q  is  the  modified  undirected  graph  corresponding 

to  G^  of  Figure  3-2  in  [24].  G21  is  G20  »  G20  is 

G^  and  G*^  is  Gj*  . 


Table  4.3 

Non-Isomorphic  Graphs  with  Different  Eigenvalues 
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4.1.4  Non-Isomorphic  Graphs  with  Identical  Eigen¬ 
values  G22  j  0*2  5  G 2 3  and  0*3  were  discovered  by  a 
computer  search  technique  and  are  taken  from  a  paper  by 
Turner  [26].  The  eigenvalues  of  G^  are  identical  to 
those  of  G*  but  G±  t  G*  ,  i=22,23  . 


Table  4.4 

Non-Isomorphic  Graphs  with  Identical  Eigenvalues 


. 
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4 . 2  Summary  of  the  Results 


The  adjacency  matrices 

A.  and 

l 

B. 

l 

,  1=1,2,. 

-.,23  , 

corresponding  to  the 

graphs 

G^  and 

G* 

l 

• 

C\J 

i — 1 

II 

•H 

..,23  , 

are  constructed  and 

used  as 

input  to 

the 

program. 

For 

each  pair  of  graphs,  G^  and  G|  ,  i=l,2,...,23  ,  the 
time  required  by  the  program  to  determine  whether  or  not 
&i  ~  G*  j  i=l,2,...,23  ,  is  obtained  using  the  timer 
routine.  The  results  of  the  timing  are  given  in 
Tables  4.5,  4.6  and  4.7.  Table  4.5  gives  the  time 
required  by  the  program  to  determine  that  G^  -  G|  for 
1  =  1,2,..,  ,19  .  Table  4.6  gives  the  time  required  to 
determine  that  G^  /  G*  for  i  =  20 , 21 , 22 , 23  .  Table  4.7 
gives  the  total  time  required  to  generate  all  permutation 
matrices  satisfying  (2.13)  for  graphs  G^  and  G|  , 
i=l,2,...,l4  .  In  the  following  tables,  i  stands  for 
the  number  of  the  graph  pair,  n  the  number  of  nodes 
and  0  the  number  of  permutation  matrices  that  are 
generated.  T-^  includes  the  time  required  to  compute 
the  eigenvalues  and  eigenvectors  of  the  adjacency  matrices 
while  T^  does  not  include  this  time.  Both  T^  and  T^ 
are  average  times,  in  seconds,  for  five  separate  test 
runs  on  the  computer. 
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Table  4.5 


Time  Required  to  Determine  that  G^  -  G| 


i 

n 

$ 

(secs ) 

( secs ) 

1 

3 

1 

0 . 0219 

0.0088 

2 

4 

1 

0 . 0586 

0 .0104 

3 

6 

1 

0 .  l66l 

0.0219 

4 

8 

1 

0.3341 

0.0339 

5 

3 

1 

0.0306 

0.0077 

6 

4 

1 

0.0508 

0.0113 

7 

6 

1 

0.1257 

0.0212 

8 

7 

1 

0 . 2246 

0.0281 

9 

10 

1 

0.5605 

0.0560 

10 

3 

1 

0 . 0240 

0.0075 

11 

4 

1 

0 . 0344 

0.0109 

12 

5 

1 

0 . 0545 

0 .0161 

13 

6 

1 

0.0767 

0.0230 

14 

7 

1 

0 . 1146 

0.0323 

15 

10 

1 

0 . 3012 

0.0765 

16 

15 

1 

0.9875 

0.2236 

17 

20 

1 

2,2035 

0.5126 

18 

25 

1 

3.9710 

0.9524 

19 

30 

1 

8.2890 

1.6174 

• 

fccve.i 
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Table  ^.6 


Time  Required  to  Determine  that  G.  /  G* 

11 


i 

n 

0 

T-^C  secs ) 

T^ ( secs ) 

20 

8 

0 

0.29^9 

0.0023 

21 

8 

0 

0.2981 

0.0023 

22 

9 

0 

0o  4214 

0.0331 

23 

12 

0 

0 . 9176 

0.0645 
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Table  4.7 


Time  Required  to  Generate  all  Permutation 

Matrices  P  such  that  A.  =  PB . P ’ 

1  l 


i 

n 

0 

T-^ ( secs  ) 

( secs ) 

1 

3 

2 

0 . 0283 

0,0131 

2 

4 

4 

0 .0714 

0.0217 

3 

6 

1 

0 . 1711 

0.0251 

4 

8 

2 

0.3603 

0,0583 

5 

3 

2 

0.0352 

0.0107 

6 

4 

8 

0.0772 

0.0363 

7 

6 

48 

0 . 4830 

0.3759 

8 

7 

14 

0 .4196 

0.2215 

9 

10 

20 

1.1750 

0.6680 

10 

3 

6 

0.0352 

0.0173 

11 

4 

24 

0 . 1010 

0.0758 

12 

5 

120 

0.5737 

0.5329 

13 

6 

720 

4.7717 

4.7226 

14 

7 

5040 

48o8ll6 

48,7396 

CHAPTER  V 


CONCLUSIONS  AND  SUGGESTIONS  FOR  FUTURE  RESEARCH 

5 . 1  Cone lusions 

The  following  conclusions  are  based  on  the  results 

of  the  numerical  experiments: 

1.  The  numerical  algorithm  for  determining  graph 
isomorphisms  developed  in  Section  3*2  of  Chapter  III 
is  capable  of  determining  isomorphisms  between  graphs 
with  distinct  eigenvalues  or  between  graphs  with  one 
or  more  multiple  eigenvalues.  Moreover,  the  algorithm 
can  detect  non-isomorphic  graphs  with  identical 
eigenvalues  as  well  as  non-isomorphic  graphs  with 
different  eigenvalues. 

2.  The  total  time  required  by  the  algorithm  to  determine 
whether  or  not  two  graphs  are  isomorphic  is  comprised, 
primarily,  of  the  time  used  in  computing  the  eigen¬ 
values  and  eigenvectors  of  the  adjacency  matrices. 

For  the  test  data,  this  time  is  60—99%  of  the  total 
time  required.  Consequently,  since  the  eigenvalues 
and  eigenvectors  are  obtained  by  Jacobi's  method, 

the  total  time  required  by  the  algorithm  to  determine 
whether  or  not  two  graphs  are  isomorphic  can  be 
significantly  reduced  by  implementing  a  faster  routine, 
such  as  Householder's  method,  in  order  to  compute  the 
eigenvalues  and  eigenvectors. 
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3.  The  time  required  by  the  algorithm  to  generate  all 
permutation  matrices  for  a  given  pair  of  isomorphic 
graphs  depends  on  the  number  of  nodes,  n  ,  and  on 
the  degree  of  symmetry  of  the  graphs.  However,  since 
the  complete  n-node  graph  has  n!  permutation  matrices, 
the  upper  bound  on  the  time  required  to  generate  all 
permutation  matrices  for  a  pair  of  n-node  graphs  grows 
as  n!  .  Thus  it  is  virtually  impossible  to  develop 

an  efficient  algorithm  to  generate  all  permutation 
matrices  for  a  given  pair  of  isomorphic  graphs. 

4.  The  algorithm  requires  up  to  n  +  n  +  -^  n  words 
of  storage  for  data  to  determine  whether  or  not  two 
graphs  are  isomorphic.  Therefore,  for  large  n  a 
considerable  amount  of  storage  space  is  required  which 
may  necessitate  the  use  of  peripheral  storage  devices. 

5.  Sussenguth’s  structure-matching  algorithm  is  more  general 
since  it  is  capable  of  detecting  sub-structure  matches. 
Moreover,  Sussenguth’s  algorithm  handles  directed  graphs, 
in  general,  without  modification  although  a  transformation 
from  directed  to  undirected  graphs  is  sometimes  used  to 
aid  in  determining  isomorphisms  between  directed  graphs. 
The  algorithm  presented  in  this  paper  can  be  modified 

to  determine  complete  isomorphisms  for  directed  graphs 
by  considering  the  problem 


A  ’  A  =  P  ( B  ’  B )  P  ' 
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and  determining  which  P's  ,  if  any,  satisfy 

A  =  PBP '  . 

5 . 2  Suggestions  for  Future  Research 

1.  Since  the  various  algorithms  for  determining  graph 
isomorphisms  have  been  programmed  in  different 
languages  and  tested  on  different  computers,  an 
accurate  comparison  of  the  efficiency  of  the  different 
algorithms  with  respect  to  time  has  not  yet  been  made. 
Moreover,  the  results  of  the  numerical  experiments 
indicate  that  a  more  thorough  comparison  is  warranted 
particularly  between  Sussenguth's  structure-matching 
algorithm  and  the  numerical  algorithm  presented  in  this 
paper.  Thus,  it  is  suggested  that  the  following  three 
problems  be  investigated  in  more  detail: 

(a)  Which  algorithm  is  the  most  efficient  algorithm 
for  determining  whether  or  not  two  graphs  are 
isomorphic  ? 

(b)  Which  algorithm  is  more  efficient  when  all 
isomorphic  mappings  of  one  graph  onto  the  other 
are  required? 

(c)  Which  algorithm  is  best  suited  for  implementation 
in  an  information  retrieval  system  taking  into 
consideration  the  storage  requirements  for  the 
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file  structures;  the  time  required  to  generate 
the  required  information  to  compare  a  query 
structure  with  those  on  file;  and,  the  type  of 
match  required  by  the  request. 

2.  Since  the  algorithm  presented  in  this  paper  depends  only 
on  the  eigenvalues  and  eigenvectors  of  the  adjacency 
matrices  and  since  the  time  required  to  compute  the 
eigenvalues  and  eigenvectors  represents  a  large  proportion 
of  the  total  time  required  by  the  algorithm,  it  is 
suggested  that  more  research  should  be  carried  out  in 
this  area  with  particular  emphasis  on  obtaining  the 
eigenvalues  and  eigenvectors  of  graphs  and  their 
adjacency  matrices.  For  example,  it  might  be  possible 
to  obtain  an  explicit  formula  for  the  eigenvalues  of 
(0,1)  matrices.  Also,  it  might  be  possible  to  simplify 
the  algorithm  considerably  by  making  a  judicious  choice 
of  eigenvectors  of  the  adjacency  matrices,  A  and  B  , 
corresponding  to  an  eigenvalue,  A^.  ,  with  mutliplicity 
n^  .  Furthermore,  since  the  algorithm  for  distinct 
eigenvalues  is  considerably  less  complicated  than  that 
for  multiple  eigenvalues,  an  investigation  into  the 
graph-theoretic  implications  of  graphs  with  distinct 
eigenvalues  as  opposed  to  graphs  with  multiple  eigen¬ 
values  should  be  made.  Perhaps,  then,  it  might  be 
possible  to  determine,  ’a  priori’,  whether  or  not  a 
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graph  has  distinct  or  multiple  eigenvalues  by  examining 
the  graph  itself. 

3.  One  of  the  inherent  problems  of  performing  numerical 

computations  on  a  digital  computer  is  that  of  determining 
whether  or  not  two  real  numbers  are  the  same.  Since 
this  problem  is  critical  to  the  numerical  graph 
isomorphism  algorithm,  an  investigation  into  the  effects 
of  zero  criteria  on  the  performance  of  the  algorithm 
should  be  carried  out.  For  example,  the  zero  criterion 
used  for  the  test  data  in  this  experiment  was  initially 
chosen  to  be  the  maximum  absolute  residual  (max  |A  -  UAU' |) 
obtained  from  re-composing  a  matrix  from  its  eigenvalues 
and  eigenvectors.  However,  using  this  criterion  through¬ 
out  the  algorithm  resulted  in  some  permutation  matrices 
not  being  generated  for  some  graphs.  For  the  test  data 
used,  a  multiplicative  scale  factor  of  five  was  found  to 
be  sufficient  to  allow  all  permutation  matrices  to  be 
generated.  Therefore,  the  effects  of  different  zero 
criteria  on  the  algorithm  should  be  investigated  more 
extensively . 
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APPENDIX 


LISTINGS  OF  FORTRAN  IV  SUBROUTINES 

The  following  pages  consist  of  the  source  listings 
of  the  Fortran  IV  subroutines  GRAPH1,  GRAPH2,  GRAPH3 , 
MAXERR  and  INTCHG  which  together  comprise  the  graph 
isomorphism  algorithm  described  in  Section  3.2  of 
Chapter  III.  MAXERR  computes  the  maximum  absolute  error 
from  re-composing  a  matrix  from  its  matrix  of  eigen¬ 
vectors  and  its  eigenvalues.  INTCHG  orders  the  eigen¬ 
values  of  a  matrix  according  to  increasing  multiplicity 
and  interchanges  the  eigenvectors  correspondingly.  The 
System  /360  Scientific  Subroutine  EIGEN  is  used  to 
compute  the  eigenvalues  and  eigenvectors  of  the  adjacency 
matrices  of  G  and  G*  .  MAXERR,  INTCHG  and  EIGEN 
are  called  from  GRAPH1.  The  source  listing  for  EIGEN 
can  be  obtained  from  the  System/360  Scientific  Sub¬ 
routine  Package  Programmer's  Manual.  The  COMMON 
variable  ZERO  must  be  initialized  to  zero;  the  number 
of  nodes,  N  ,  and  the  adjacency  matrices,  A  and  B  , 
must  be  assigned  values  before  calling  GRAPH1.  The 
adjacency  matrices,  A  and  B  ,  of  G  and  G*  are 
stored  as  vectors  with  the  upper  triangular  portion 
stored  columnwise  in  successive  locations.  If  the 
eigenvalues  of  A  and  B  are  different,  then  the  COMMON 
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variable  RHO  is  zero  upon  exiting  from  GRAPH1;  G  ^  G*  ; 
and,  GRAPH2  and  GRAPH3  must  be  bypassed.  Otherwise, 
the  graph  isomorphism  algorithm  is  implemented  by 
calling  successively,  the  subroutine  GRAPH1,  GRAPH2 
and  GRAPH3. 

A  control  program,  together  with  numerical  examples, 
is  also  included. 


*1 
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S  0  Li  P  C  (J  I  1 1\  t 

1  GKAPH1 IN  ,  A  .  B  7  U  ,  V,  ti,  P,  L  ,  P5  PI  ,MMf  ALPHA,  BE  TAj GAMM , X l 

C 

C  THIS  SOBRuUTINt  COMPUTES  THE  EIGENVALUES  Ai*u 

U  EIGENVECTORS  OF  A  d  d  BY  JAOGbi^S  METHOD*  T  tic  N 
C  MATRICES  L-dAR  TkANSPGSE,  M-dAR  t.  G  ARE  GENERATED. 

C 

D I MENS  ION  All), Bll), Xi  1 ) , PI  (  1 ), MM ( 1 i , ALPHA (1J , BETA (1) , 

1  GAM Ml  1)  ,U(N»N)  ,V l  N  » N  )  ,MIN,N) ,Q{N»N) ,P (N,N)  » 

2  L  1  N  ,  N  ,  N  i 
COMMON  ZERGfRHu 

INTEGER  P,PI  , ALPHA , b  ET  A , GAMM  »  G , T  t  RHO 
REAL  L,M 
N1=1N*(N+1) ) / 2 
C 

C  CALL  SSP  ROUTINE,  EIGEN,  TC  COMPUTE  U,V  d  LAMBDA. 

C 

K  =  C 

CO  2  J -  1  , N 
K=  K  +  J 

A  1 K ) =A ( K ) +N 
ti 1 K ) =8 ( K ) +N 

2  CONTINUE 
CO  3  J  =  1 »  N 1 
X  1  J  )  =  A  1  J  ) 

3  CONTINUE 

CALL  EIGEN  (  A  ,  U , N , 0 ) 

CALL  MAXERR  TO  COMPUTE  ZERO  TOLERANCE 

CALL  MAXERR  1  A  ,  X , U , Z ERO , N ) 

DC  4  J— 1  ,  N 1 
XI J ) =b ( J  ) 

4  CONTINUE 

CALL  EIGEN  (B,V,N,0) 

CALL  MAXERn  (E ,X, V ,ZlRC,N) 

c 

C  CHECK  TC  SEE  IF  EIGENVALUES  OF  A  d  B  ARE  IDENTICAL 

C  ANC  COMPUTE  RHC,  THE  NUMBER  OF  DISTINCT  EIGENVALUES, 

U  AND  MM (  I  )  ,  THE  IK  CORRESPONDING  MULTIPLICITY. 

C 

J  =  C 
RHC=  1 
T=  1 
K=  1 

K 1=  N  +  I 
X( 1)=A{ 1  ) 

X  (  K  1 )  =  B  (  1 ) 

IF1ZERC.LT.aBS1  (X(  l)-X(Kl)  ) / X ( 1) )  )  J=1 
DC  20  1  =  2, N 
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K  —  K  +■  I 
N1=K1+1 
X( I  )  =  A  (  K  } 

X  (  K  1  )  —  6  (  K  ) 

TEMP=X ( I  )  -X  (  K  1 ) 

IF ( ZERO, Li. A  fc!  S ( TEMP)  . AND . ZERO. LT . ABS (  rtMP/X( I  )  )  )  J  =  1 

t e m p = x ( n-x(  i-ij 

IF ( ZERO. GE.ABSI TEMP)  .OR  .ZERO  .GE . ABS l TfcMP/X ( I ) ) )  GO  TO  19 
MM ( RHO ) =  T 
KHL=RHC+ 1 
T  =  G 

19  T=  T  +  1 

20  CONTINUE 
MM ( RHQ  )  =  T 
N1=N+ 1 
N2=N+N 

IF(J.Eu.O)  GO  TO  21 
hRITE(6,120) 

120  FORMAT!*-*,*  **  A  AND  B  ARE  NOT  ISOMORPHIC  **  »/•-') 
RHC  =  C 
RE  TORN 

21  CONTINUE 

CALL  INTCHG  TO  ORDER  THE  EIGENVALUES  ACCORDING  TO 
INCREASING  MULTIPLICITY 

CALL  INTCFG  ( o  ,  V , M  ,  MM , AL PhA , G AMM , N , RHO ) 

bENERATh  v^-MATRIX  OF  DIMENSION  N-BY-RHJ 

DC  29  1=1, N 
K2  =  C 

DO  27  J=  1 , RHC 
K  1  =  K2  +  1 
K2=  K2  +  MM ( J ) 

DO  23  K=  K  1  , K 2 

IFtZERC.LT .  ABS ( U ( I ,K) ) )  GO  TO  23 
23  CONTINUE 
Qi  I  » J)=K2 
GC  TO  27 
25  C( I , J )=K 
27  CONTINUE 
29  CONTINUE 

GENERATE  ThE  N  MATRICES  L-BAR  TRANSPOSE  AND  M-BAR 

DU  39  1=1, N 
K2  =  0 

DO  37  J 1  =  1 , R  h  G 
K 1  =  K  2  +  1 
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K2-K2+MM ( Ji ) 

I  ~  0  (  I  j  J  1  J 
TtrMP  —  U(I  t  I  w  ) 

IF ( 2ERC.LT . A  e  S l T  E  H  P i  )  TEMP-l/TEMP 
CO  3  5  K  =  K  i  ?  N  2 
HI»K)=UII(K)  *T£MP 
CO  3  3  J  = i t N 
L  (  i  t  J  t  K  )  =  V  (  J  t  N  )  T  E  iv-  P 
33  COfMINOE 
35  CONTINUE 
37  COM I  N  C  E 
5  5  CUNT  IN  IE 
RETURN 
END 
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SUBftUU  T I NE 

i  G  R  A  P  H  2  (  N  »  A  »  3  »  U »  VfQjMjLt  P  »  I N  D  >  M  M  »  A  L  P  H  A  t  b  E  T  A  »  G  A  /'I  M  i  X  j 

THIS  S  U  B  R  0  C  T  i  n  e  chooses  linearly  independent 
ROWS  U  F  M  -  8  A  R  l  i  )  ,  I  -  1  »  2  ?  .  .  .  >  kHG  »  AND  COMPUTES  THEIR 
INVERSE  USING  GAUSSIAN  ELIMINATION  WITH  PARTIAL 
PIVOTING.  THE  VECTORS  ALPHAjbETA  A  GAMMA  ARE  GENERATED. 

DIMENSION  A ( 1 )  »  B ( I )  »  X ( I ) »  IND (  1 ) , MM (l),ALPHA(I)fBtTA(l), 

1  GA  MM ( 1 ) , U ( N , N  )  ,  V  ( N  ,  N )  .  M  l  N ,  N  J  »  w  (  N  ,  N  )  ,  P  ( N ,N), 

2  L  (  N  » N »  N  ) 

COMMON  ZERGtBHU 

INTEGER  P  » I N  D  *  ALPH A  »  oE  TA  » uAMM  »  G  »  T  »  RHG »  T I 
REAL  L  j M 
DC  5  I  —  1 »  N 
ALPHA ( l )  =  I 
BETA  { I  )  =  0 
GAMM  (  IJ  =0 
IND (  I  )  =  I 
CD  3  J  =  1 »  N 
U( I , J) =0 
V ( I »  J ) =0 

IFU.EC.J)  V  (  I  ♦  J  )  =  I 
P  (  I  »  J ) =2 
3  CONTINUE 
3  CONTINUE 
C 

C  CHOOSING  LINEARLY  INDEPENDENT  ROWS  OF  H  —BAR 
C 

K2  =  0 
T=G 

DO  61  1=1* RHL 
Kl=N2+ I 
K2= R2  +  MM  (  I  ) 

IF ( K2.NE.KI  )  Gu  TO  L7 
C 

C  PROCEDURE  FGk  DISTINCT  EIGENVALUES 
C 

Du  10  J=  1  f N 
K^ALFHa ( J  ) 

I F { ABS( l.-M(K,Kl  J  )  .LT.ZERC)  GO  TO  12 
10  CONTINUE 

WRI TE ( 6, 190 ) 

190  FORMAT  ('  ERROR.. NULL  EIGENVECTOR  *) 

GU  TO  61 

12  IF(J.LE.T)  GO  TO  15 
T  =  T  +  1 

IFlJ.Ew.T)  GC  TO  13 
ALPHAl  J)=ALPFAm 
ALPHA ( T ) =K 
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15  GAN F,  (  K  1  )  =  R 
BETA { I)=T 
GO  TO  61 
C 

C  PRLC  EDURE  FOR  MULTIPLE  EIGENVALUES 

17  T1=MMII) 

IF ( T  .GT.  (K2-K1 )  )  GC  TU  19 
T=K2-Ki+1 

19  3  E  T  A  (  I  )  =  T 
K=  C 

LC  21  J=  K 1 »  K 2 
K  =  K  +  1 

I  0= ALPHA { K ) 

CG  2  0  J  1  -=  K  1  »  K  2 
U(J»Jl)-N(ID»Ji) 

20  CONTINUE 
G  A  M  N  (  J  J  =  I  C 

21  CONTINUE 

FINDING  PIVCT  ELEMENT  FOR  ELIMINATION 

23  DO  25  II=K1,K2 
INC (  I  I  )  =  I  1 
25  CONTINUE 

CO  5  1  1  I-=Kl  »  K2 
CMAX=ZERC 
CO  27  j= I  I »  K 2 
K= I  NO ( j) 

TlMP-ACS i U ( K  »  I  I  )  ) 

I  F (  (CM  AX-TEMP)  .  G  E . 0 .  )  GO  TO  27 
CMAX=TENP+ZERC 
ID*  J 

27  CONTINUE 

IF(ZEkC.LT.CMAX)  GO  TO  41 

DETERMINE  *HICH  DEPENDENT  ROW  IS  TO  BE  REPLACED 

DC  31  J=  I  I  »  K2 
K=  I  NO ( J ) 

CO  29  J 1  =  1 1 »  K2 

IF(ZERC.lT.ABS(UIR»J1)  ))  GC  TO  31 
29  CONTINUE 
GO  T C  3  3 
31  CONTINUE 
GC  TO  51 

GENERATE  ALPHA, BETA  0  GAMMA  VECTORS 


33  T  1  =  T  1+  1 
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I  K= ALPHA (Tl) 

GAMM ( K  I  =  I K 
IF(l.Ev*.lI  GC  TG  35 
IF(T.GT.Ti)  G C  TU  37 

IF(K.GT.K2  +  BETA( I-1I-BETAI  II)  GU  TG  35 
T-T+  1 
BETA (  I  I  =  T 
GG  TC  37 
35  KT  =  K-K  1+  1 

ALPHAl Tl  )=ALPHa(KT I 
ALPHAUT  )  =  I  K 
37  CC  39  J1-K1,K2 
U  (  K  »  J  1 )  =  N  ( IK,  J 1 ) 

V  (  K  »  J  1  )  -  C 

IF  (  K  •  Ev*  •  J  1 )  V ( K  ,  J i )  =  1 
39  CUNT  INGE 
GG  TG  23 

41  IF  (  1 1 . tG  .K2  I  GG  TO  5  1 
IF(II.EG.IL))  GU  TG  43 

INTERCHANGE  ROW  INDICATORS  FUR  ELIMINATION 

K=  IND (  I  D  > 

IND( ID  )=  INU (  III 
I NU (II )  =  K 
43  KK=II+1 
ID=  IND  <  I  I  I 

C  GAUSSIAN  ELI -MIRATION  FUR  MM  (II  RIGHT  — HAND  SIDES 
C 

DU  49  1 1- KK  » K 2 
K=  I  NO (  I  1  I 
TEMP  =  U ( K  ,  I  I  ) 

IF ( TEMP. Eg. 09 )  GU  TG  49 
TEMP=-TEMP/U ( IL, I  I ) 

U  (  K  »  1 1 )  =  0 
DU  45  J=KK , K2 

U(K,J)=U(K,J I+TEMP^UI ID,J) 

45  CONTINUE 

DU  4  7  J—  K  1  , K 2 

V ( K , J I = V ( K , J  )  +T  EMP  *V ( I D , J I 
4  1  CONTINUE 
49  CONTINUE 
51  CONTINUE 
C 

C  BACK  SUBSTITUTION  TU  OBTAIN  ThE  INVERSE 
C 

K I  =  F  M  1  )  -  1 
KK  =  K  2-  1 
IK- I  NO ( K 2  I 


70 


DC  59  1 1-K  I »  K2 
X(K2)=V{IK,IIJ/U(IK,K2) 
DC  55  I  1  =  1  »  K I 
K— R  2  ~  I  1 
J  1  =  I  ND  (  K  } 

X(K)=V(J1»II) 

CO  53  J=K ,Kl\ 

53  CUNT INUE 

X(K)=X(Ki/U( J1,KJ 
5  5  COMINCE 
C 

C  INVERSE  STOREC  IN  V  RATRIX 
C 

DO  57  J—  K i f  K 2 
V  (  J  #  I  I  i  =  X  (  J  ) 

57  CONTINUE 
59  CONTINUE 
fc  1  CuNTINUE 
C 

C  END  OF  ROUTINE 
C 

RETURN 

END 


■ 

■ 
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SUbRCU  TINE 

1  GRAPh3 IN»A,  B»U,V,G,M1,L,P»PI » M  H  *  ALPHA  , BE  TA »  GAMM ,  X I 

THIS  SUbRCUT  I  N  c  COMPUTES  L  TESTg  DELTAII),I=1, 

2  ,  • • • , R h G ,  AND  GENERATES  ALL  PERMUTATION  MATRICES 
SUCH  ThAT  A  =  PBP  •  IF  GRAPHS  G  C  b*  ARE  ISOMORPHIC. 

DIMENSION  A(l),B(l],X(l),PI(l)  ,  MM ( I)  , ALPHA!  I) , B  ETA (  II , 

1  G  A  M  M I  1 1  »  U  (  N ,  N  )  » V  I  N  ,  N  )  »  Ml  (  N »  N  I  ,  Q  (  N  » N  I  ,  P  ( N  ,  N )  , 

2  L  (  N  ,  INI ,  N  ) 

COMMON  bERO,RHO 

INTEoErv  P  ,  P  I  , ALPHA, BET  A,  GAMM  »  w  ,T  ,RH(J»BTR,T1 
REAL  LfM 
ZERC=5*ZERO 
NG  I  =  C 

B TR  =  BE TA l RHU  I 
I  M  =  M  M  (  1 1 
1  M  P  =  I  M  +  1 


GENERATE  THE  PCSSlbLE  CHOICES  FOR  THE  FIRST  MM 4  1) 
ROWS  CF  P  AND  M A R E  ASSUMPTIONS 

CO  5  I  =  1  »  N 
I D=  ALPHA (  I  ) 

IF(I.GT.IM)  GL  TO  2 
DO  1  J=  1  ,  N 
PI IC, J)=C 

IF { J  ,GE  .  I  I  P (  ID, J ) =1 

1  CONTINUE 
PI {  I C  )  =  I 
GO  TC  5 

2  DO  3  J=L,  I  Ml 
PI  ID, J  )=-l 

3  CONTINUE 
5  CONTINUE 

1  =  1 

J  =  b  E  T  A (  I  ) 

K=  J 


COMPUTE  AND  TEST  DElTA(I) 

7  K2  =  C 

CO  9  11=1,1 

K1=K2+ 1 

K2  =  K 2  +  MM  III) 

9  CONTINUE 

DO  13  Il=Kl,K2 
ID  =  GAMM  (ID 
IP  =  P I  I  IC ) 

DC  11  J  1  =  R 1 , K  2 


o  o  o  o 
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U  (  I  1 , J 1 >  =  L (  ID  ,  IP , J  1  i 
II  CONTINUE 
13  CONTINUE 

DO  19  I  i-N 1 , K 2 
DO  lb  Ji=Kl»K2 
XI  Jl  )  =  C 

CO  15  J2  =  K  1 , K2 

X(Jl)  =  XUl)  +  V(Jl,J2)*U(J2,U) 

15  CONTINUE 
lb  CUNTINUE 

DO  17  JL=NljK2 
U( J2,  I  1)=X( J  2 ) 

17  CUNTINUE 
19  CUNTINUE 
ERR  =  C 

DO  23  I1  =  M,K2 
DO  22  J  1  =  R  1 ,  K 2 
T  EMP  =  G 

CC  21  J2=K1 t K2 
TfcMP=TLMP  +  UlJ2,U)*U(J2,Jl) 

21  CONTINUE 

I F (  I1.EC.J1 )  TEMP=1.-TEMP 
ERR=ANAX1  (ERR,  ABS(  TEMP)  ) 

22  CONTINUE 

23  CONTINUE 

IF(ZckO.LT.ERR)  Gu  TO  43 
1=1  +  1 

IF  (  I  .LE  .RHO  )  DO  TO  25 
J=N 

GC  TC  27 

TEST  TO  SEE  IF  FORE  RC^S  OF  P  ARE  REQUIRED  TO  COM¬ 
PUTE  ThE  NEXT  DcLTA 

25  IMEETAC  I  )  .EQ.BETA(  1-1  )  )  GO  TO  7 
J  =  6  E  T  A  (  I  ) 

27  K=  K  +  1 

L  CALCULATE  POSSIBLE  CHOICES  FOR  RONS  OF  P  THAT  ARE 
C  KEGUI RED 
C 

DO  41  T=  K  ,  J 
ID= ALPHA ( T ) 

DO  31  J  1=  1 , K 2 
X  {  J  1 )  =  C 
DO  29  J  2  =  1 , K  2 

X  (  J  1  )  =  X  (  J  1 )  +  F  (  I  D  ,  J  2  )  *U  (  J  2  ,  J  1  ) 

29  CONTINUE 
31  CONTINUE 

DO  4  0  J 1  =  1 , N 


■ 
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IP-PI  IL, J 1 ) 

IF ( IP.EG.-l )  GU  r G  40 
CO  37  J  2= 1 »  K  2 
TEMP=L l I C, J1  ,  J2) 

IF ( TEMP.EQ.O .0)  GU  TO  37 
TEST— X(J27-TEMP 
IF ( ABS ( T  EPP ) -  1 .  )  33,33,35 
33  IF (ZERO. LT .ABSt TEST) )  GU  TO  39 
GU  TO  37 

35  IF(ZERC.LT.A6S(TE6T/TEMP) )  GO  TO  39 
37  CONTINUE 

IF ( I P . EC  .0  )  GO  TC  40 
P(  I  U , J  L )  =  1 
GO  TC  4 C 

39  IF(T.GT.BTR)  GU  TO  40 
P(IC,Jl)=-l 

40  CONTINUE 

41  CONTINUE 
In= Alpha ( K ) 

GO  70  46 

GENERATt  ALL  PERPUTAlIoN  ivi  A  T  R  I  L  E  S  FOR  THIS  CHOICE  OF 
P  RUrtS  OF  P 

43  I  K  =  AL  PHA ( K ) 

I  L)=  P  I  (  IK  ) 

CO  A  5  T  =  K  ,  N 
I  T^ALPHA 1 T ) 

PUT  ,  IC)  =2 
45  CONTINUE 
4  7  P<  IK,  10  =  0 
4b  LO  50  T= 1 , N 

IF(P(IK,T).EC.1J  GO  TC  61 

50  CONTINUE 
C 

L  STlRT  BACKTRAC  K  IimG 

c 

IF  (K  .Eg.  1  )  GO  TO  60 

51  IF(K.GT.BETA(I-1)+1)  GO  TO  75 
DO  55  T 1 =K  ,  N 

I T= ALPHA { T  I  ) 

CO  5  5  T  =  K , N 
IK=ALPHA  (  T  ) 

I D=P  I  (  IK  ) 

PI  IT,  10  =  2 
53  CUNT  I NUE 
K=K-  1 

CO  57  T=  I ,  RHC 
IF  IK. LE. BETA <T)  )  GU  TU  bO 
57  CONTINUE 


. 
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60  I  =  T 

J  =  6  E T  A  (  I  ) 

GC  TC  ^3 

61  I L=  P I ( I K ) 

GG  63  IJ=1,N 

IF  l  P  1 1  I  J  }  .  t  G  •  T  )  Gu  TG  64 

63  CONTINUE 

64  P  I  (  I  J  )  =  I  L 
P  I  ( IK  )=T 

IF(K.E^.N)  GC  TG  7ti 
I  I  =  K  +  1 

IP (  I  .Eu.l  )  GC  TG  67 
CO  65  I T  =  1 1  »  N 
Iu= ALPHA  (IT) 

IF(Pl IC, T) .NE.l)  uG  TU  65 
P( Il,T  )=C 

65  CONTINUE 
GG  TC  70 

6  7  CC  6  5  I  T  —  I  I  ,  N 
Iu=ALPHA (  IT  ) 

P(  IG,T)=G 

IP(  IT.uT  .  I M )  P(ICiT)=-l 
6S  CONTINUE 
70  IF(K,t«.J)  GC  TG  7 
K  =  K  +  1 

IK= ALPHA (K) 

GU  TG  48 

75  GG  76  T1=K, J 
I T  =  ALPHA (II) 

DU  It  T  =  K  ,  N 

I K=  A  L  PH A ( T ) 

I  D=  P  I  (  IK  ) 

I  F  (  P  (  IT,  ID  .  i\  t .  C  )  GG  TG  76 
PUT,  l  L  )  =  1 

76  CONTINUE 

IK—  ALPHA(K-1  ) 

10=  P  I  l  IK  ) 

GC  77  T  =  K , J 
IT=ALPhA  (  T) 

I  F  (  P  (  IT,  ID  .  NE  .  0  )  GG  TG  77 
PUT,  IL)  =  1 

77  CONTINUE 
K=K-1 

GO  TO  47 

OUTPUT  PERMUTATION  MATRICES 
73  NGI=NGI+1 

rtRITcI  6,200)  NG I ,  ( P  I  (  I  I  )  , I  I = 1 , N ) 
GG  TC  51 


75 


c 

C  END  C  F  R  C  Ij  I  1 N  t 
C 

SO  i  F  l  N  G  I  •  E  0  •  0 )  GO  TG  83 
hRITElfc»2Cl) 

RETURN 

83  *R1 It ( b, 202 ) 

RETURN 

200  FORMA T  l  1 ,  I  15,  1  .  .  '  , 2514 ) 

201  FORMAT **  NO  MURE  ISOMORPHISMS  **  •/*-*) 

202  FORMAT **  A  AND  B  ARE  NOT  ISOMORPHIC  **  •/' 
END 


' 


■ 
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SUBRGU  TINE  M  A  X  E  R  R  I A  » B  ,  C  »  c  RR  »  N » 

TtilS  SUdRCUTIiNic  CALCULATES  THE  MAXIMUM  RESIDUAL 
FROM  RE -CO  MFCS 'INC  A  M  A  T  K  I  X  »  B  ,  FROM  ITS  MATRIX  uF 
EIGENVALUES  ,  A ,  AND  EIGENVECTORS »C.  IE. MAX  ABSIb-CAC'). 

DIMENSION  All),B(l),C(N,N) 

DC  17  J-  1  ,  N 
DO  1 5  1  =  1, J 
I  J=I  +  J*{ J-l ) /2 
TE  M  P  =  0 
L  =  0 

DO  13  K=1,N 
L-  L  +  K 

TEMP=TeMP+A( L)*C( I  ,K)*C( J,K) 

13  CONTINUE 

ERR  =  AMAX1  (  ERR,  ABS  l  B  (  I  J  I  —  A  B  S  (  T  E  IS  P  )  )  ) 

13  CONTINUE 
17  CONTINUE 
RETURN 
END 
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iUoRuUTINE  I  N  T  C  H  G  (Af3tCyl0fiDlfIU2fMiyNK) 

C 

C  THIS  SlbKLUTINE  ORDERS  THE  EIGENVALUES  CF  A  L  B 

C  ACCORDING  TO  I  NCR  E AS  I No  MULTIPLICITY  A NO  INTERCHANGES 
C  THE  COLUMNS  OF  ThE  MATRICES  OF  EIGENVECTORS  U  E  V 
C  CORRESPONDINGLY. 

r 

U 

DIMENSION  A ( N  ,  N )  , BIN, N),C(N,N),ID(l),lDl(i), 102(1) 

Nl-NR-1 

CO  I  I  1  =  1  ,N 

IQ1 (  1 1  )  =  i  I 

1  CONTINUE 

CO  11  I  =  1 »  N 1 
I  T  =  0 
N  I  -NR-  I 
DO  9  J=1,NI 
N J=NR- J 
K=N J+l 

IF  <  ID(NJ)  .LE.IO(K) )  GO  TO  9 
K2  =  C 

DO  2  I  I  =  1  ,  K 
K 1  =  K  2+  1 
K2=K2+  ID  (  I  I  ) 

2  CONTINUE 

DO  3  I  I-=K  1 »  K2 
IU2 ( I  I )  =  ID1 (  11) 

3  CONTINUE 
M K  = I G ( NJ  ) 

K4=K2+  1 

DO  5  I  1=1, MR 
K3=K 1-  1  I 
K4  =  K  4-  1 

ID1(K4)=IC1 ( K  3  J 
3  CONTINUE 

DC  7  I  I  =  K 1 »  K2 

K  3= I I-MK 

III  1  (  K  3  )  =  1 02  (  I  I) 

7  CONTINUE 
I  T-  I  D  (  R  ) 

ID  (  K  )  =  ID  (  N  J  ) 

IO(NJ)=IT 
9  CONTINUE 

IF  I  I T . EG.O  )  GO  TO  13 
11  CONTINUE 

13  IF (  I  .EC.  1  )  GO  TO  19 
DG  16  1  =  1 » N 
K= I D  1  (  I  ) 

KT= I D 1 (K) 

DO  15  J  =  1  t  N 
C(J,I)=A(J»K) 
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A  l  J  »  K  )  -  B  (  J  »  K  T  } 
lb  CUMINUL 
lb  CUM  INGE 
DU  Id  I  =  1  ,  ;N 
C  G  17  J  =  1 »  N 

A (  I  »  J  )  =  G  (  I  »  J  } 

17  CUM  INGE 

18  C u NT  I N  G  E 

19  RETGKN 
END 
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CONTROL  PROGRAM 


DIME  NS  I  ON 

1 

2 

D I  MENS  I  ON 
I  N  T  E  G  t  R  P 


A ( 4  65 )  , 8 ( 465  )  , X { 4 o5  )  , U ( 3r  ,  3  0  )  , V ( 35, 30 )  , 

M  (  3  0 , 3^  )  ,  g  (  30 , 3  r  }  ,  P  (  3  C  ,  3  C  )  ,  L  (  3 1 , 3  0 , 3  0  )  , 

P I ( 30  )  , MM { 3 P ) ,  ALPHA ( 30 ) , BET A( 30 ) , GAMM (30 ) 
FMT (18) 

P I  , ALPHA, BETA , GAMM  ,  Q, T , RHO 


COMMON  ZERO, RHO 
REAL  L , M 


INPUT  ALB 


10  R  E  A  D ( 5 , 10  0, E  N  D  =  5  0  )  N 

N 1  =  N  o ( M+l) /? 

R  E  A  D ( 5 ,  1  o 1 }  F»T 
WRI TE (6 , 102 ) 

R  E  AD ( 5 ,  FMT)  ( A (  I  )  ,  I =1 ,N1  ) 

READ ( 5, FMT )  (  B (  I  )  ,  I - 1 ,N1  ) 

INVOKE  GRAPH  ISOMORPHISM  ALGORITHM 

Z  E  R  0  =  0 

CALL  GRAPH 1 ( N , A , B,U , V , U , M, L , P, P I ,  MM , ALPHA , BETA, GAMM, X ) 
IF(RHO.EQ.O)  GO  TO  10 

CALL  GRAPH2 ( N , A, 3,U , V , Q , M, L , P ,P I , MM , ALPHA, BETA, GAMM, X) 
CALL  GR  A  P  H  3 ( N  »  A , B , U , V ,Q,M,L,P , P I  , MM, ALPHA, BtTA, GAMM, X) 
GO  TO  10 
5r'  STOP 

100  FORMAT (  I  10 ) 

101  FORMAT (18A4) 

10  2  FORMAT (  •  1  ’ ) 

E  N  D 


’ 


. 
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ISOMORPHIC  EXAMPLE 


INPUT  DATA 
4 

(  8  F  1  0 . 0  ) 


0.0 

1 . 

1  .'3 

0.0 

0.0 

0.^ 

1.0 

0 . 0 

1.0 

0 . 0 

0. 3 

1  .  2 

1 . 0 

r\  -\ 

v  •  - 

0.0 

1.0 

0 . 0 

n  n 

-/•A 

0.0 

1  • 

COMPUTER  OUTPUT 


1 .  . 


4 


2.  .  1 


4 


3  .  . 


4 


4  .  . 


2  4 


5.  . 


1  2 


6.  . 


3  4 


7.  , 


4  2  13 


8. 


4 


1  2 


NO  MORE  ISOMORPHISMS 
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NON- ISOMORPHIC  EXAMPLE 


INPUT  DATA 
9 

(  3  F  1  0 . 1  ) 


0  . 

a 

) 

0  . 

A 

A 

V  5 

• 

pi 

I 

n 

1 

o 

0. 

o 

o 

• 

o 

0.0 

I . 

A 

j 

0. 

A 

n 

• 

0 

‘y 

p 

1 

o 

A 

’  y  • 

0 

0 

• 

o 

0.0 

0. 

o 

■w  • 

A 

i 

• 

p 

1 

A 

9 

p 

'J  • 

n 

A 

• 

0 

0 . 0 

0. 

o 

p 

A 

i 

• 

o 

r\ 

0 

;A 

p 

A 

J  • 

p, 

A 

y 

• 

0 

1 . 9 

1 . 

A 

0 . 

/-* 

'  ! 

0 

• 

p 

A 

A 

A 

p 

0. 

o 

0 

• 

9 

0 . 0 

0. 

9 

/•> 

u  • 

A 

J 

Q 

• 

0 

l 

0 

A 

p 

0. 

1 

1 . 

A 

o 

• 

0 

a 

A 

1 

A 

A 

• 

n 

0 

• 

A 

0.  0 

1 . 

0 

3. 

A 

o 

• 

p 

Q 

ft 

n 

a 
i  1 

1 . 

P 

A. 

• 

0 

j 

0.0 

I . 

,p 

rv 

0 

• 

n 

0 

A 

n 

p 

0. 

p 

1 

• 

o 

0 . 0 

1 . 

Q 

n 

0 

• 

c 

A 

a 

0 

A 

0. 

0 

C 

• 

0 

0.0 

rs 

'  • 

0 

0. 

r 

1 

• 

p 

A 

> 

n 

P 

0. 

p 

0 

• 

o 

0.0 

0 . 

A 

o 

o 

Q 

• 

p 

1 

A 

A 

Q 

COMPUTER  OUTPUT 

A  AND  3  ARE  NOT  ISOMORPHIC  ** 


■ 


